iFACE: A 3D Synthetic Talking Face

نویسندگان

  • Pengyu Hong
  • Zhen Wen
  • Thomas S. Huang
چکیده

We present the iFACE system, a visual speech synthesizer that provides a form of virtual face-to-face communication. The system provides an interactive tool for the user to customize a graphic head model for the virtual agent of a person based on his/her range data. The texture is mapped onto the customized model to achieve a realistic appearance. Face animations are produced by using text stream or speech stream to drive the model. A set of basic facial shapes and head action is manually built and used to synthesize expressive visual speech based on rules.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Real-time speech-driven face animation with expressions using neural networks

A real-time speech-driven synthetic talking face provides an effective multimodal communication interface in distributed collaboration environments. Nonverbal gestures such as facial expressions are important to human communication and should be considered by speech-driven face animation systems. In this paper, we present a framework that systematically addresses facial deformation modeling, au...

متن کامل

Socially Expressive Communication Agents: a Face-centric Approach

Interactive Face Animation Comprehensive Environment (iFACE) is a generalpurpose software framework that encapsulates the functionality of “face multimedia object”. iFACE exposes programming interfaces and provides authoring and scripting tools to design a face object, define its behaviors, and animate it through static or interactive situations. The framework is based on four parameterized spa...

متن کامل

Face as a Multimedia Object

This paper proposes the Face Multimedia Object (FMO), and iFACE as a framework for implementing the face object within multimedia systems. FMO encapsulates all the functionality and data required for face animation. iFACE implements FMO and provides necessary interfaces for a variety of applications in order to access FMO services.

متن کامل

Talking Head: Synthetic Video Facial Animation in MPEG-4

We present a system for facial modeling and animation that aims at the generation of photo-realistic models and performance driven animation. It is practical implementation of MPEG-4 compliant Synthetic Video Facial Animation pipeline (Simple and Calibration Profiles with some modifications), which includes: facial features recognition & tracking on real video sequence; obtaining, encoding, net...

متن کامل

Socially Communicative Characters for Interactive Applications

Modern multimedia presentations are aggregations of objects with different types such as video and audio. Due to the importance of facial actions and expressions in verbal and non-verbal communication, the authors have proposed “face multimedia object” as a new higher-level media type that encapsulates all the requirements of facial animation for a face-based multimedia presentations within one...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Int. J. Image Graphics

دوره 1  شماره 

صفحات  -

تاریخ انتشار 2001